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Similarity  measures  on  Binary  Attribute  Data 
F.  Janowitz  * 

Farris  (197?)  compares  nhenetic  with  nh.ylogenetic 
taxonomy  and  claims  to  have  established  the  superiority 
of  the  phylogenetic  system.  Upon  reading  his  paper  I  found 
that  I  d  id  not  agree  with  a  certain  nortion  of  his  reason- 
ins'  (Janowitz,  1979),  though  I  took  no  position  on  the 
validity  of  his  conclusion.  The  inevitable  vituperative 
>~enly  occurs  in  Farris  (1979).  Though  it  is  tempting  to 
respond  in  detail  to  the  assertions  made  in  this  reply, 
sober  reflection  leads  me  to  the  conclusion  that  the  reader 
will  be  better  served  if  I  do  not  do  so.  After  all,  this 
is  riot  a  debate  where  the  person  who  makes  the  most  skillful 
use  of  the  English  language  is  declared  the  winner!  rather, 
there  are  some  facts  about  cluster  analysis  that  both 
"arris  and  I  are  trying  to  establish.  Unfortunately,  our 
baric  underlying  principles  are  so  drastically  different 
that  we  seem  destined  to  arrive  at  differing  conclusions. 

The  reader  must  decide  for  himself  the  relative  merits  of 
our  two  positions,  and  for  that  reason  I  shall  devote  the 
present  paper  to  clarifying  and  expanding  upon  the  points 
that  were  made  in  my  original  paper. 

£l.  Farris  (1979)  is  quite  correct  in  mentioning  some 
mistakes  in  arithmetic  that  occurred  in  my  earlier  paper 

Research  ,.u;.  •  rtc.1  by  Contract  NPO''l4-79-C-9629  as 
well  as  by  .-/rants  **rom  the  University  of  Massachusetts 
Computer  Center. 
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( some  of  these  were  typographic^ "I  errors,  and  some  pure 
carelessness  on  my  part),  and  then  proceed s  to  demonstrate 
precisely  the  point  that  T  was  trying  to  make.  ”y  con¬ 
sidering  artificial  examples  one  can  produce  situations 
where  nhemetic  methods  are  super  i  or  to  ohyl  ogene  ti  c 
methods  and  conversely.  Indeed,  he  ?oef  even  further  than 
this  when  he  states  (Farris,  1979*2f6)  that  ,,T,y  suitable 
choice  of  data  sets,  any  method  of  classification  can  be 
made  to  appear  as  unstable  as  one  pleases.”  It  follows 
that  one  cannot  draw  a  general  conclusion  from  the  con¬ 
sideration  of  a  specific  example.  Since  this  is  one  of 
the  points  I  was  trying  to  make  with  ny  example  (Janowitz. , 
1979*197),  it  is  gratifying  that  Farris  agrees  with  me. 


2.  What  is  the  significance  of  th°  example  provided 
by  Farris  (1977*837)7  For  the  reader's  convenience  the 
examnle  is  reproduced  in  Table  1  and  Fi<T.  1.  This  example 
involves  binary  character  data  where  1  is  always  taken 
to  be  the  preferred  state.  If,  as  Farris  claims,  his 
special  clustering:  is  in  general  superior  to  raw  clustering, 
I  would  expect  this  superiority  to  manifest  itself  in 
this  very  specific  situation.  Since  it  is  especially 
easy  to  see  what  is  happening  in  such  a  situation,  I 


cannot  lose  anything  by  restricting  my  attention  to 
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an  assumption  that  was  implicitly  made  in  my  earlier  paper 
also.  In  Farris’  terminology  (Farris,  1979*202)  the  re ference 
noint  is  taken  to  possess  all  0  states!  he  and  I  then  seem 
to  agree  (Farris,  1979*202)  that  his  measure  s  represents 
the  simple  matching  coefficient  (DC1  in  Table  2),  while 
his  coefficient  of  special  similarity  a  reduces  to  the 
coefficient  of  Russel  and  Rao  (DC4  in  Table  2).  When  either 
s  or  a  is  applied  to  the  data  of  Table  1  and  followed  by 
UPGMA  clustering,  the  result  is  the  classification  of  Fig. 
1(a).  Farris  argues  (1977*832)  that  since  the  associated 
conhenetic  correlation  coefficient  is  1.00,  and  since 
"each  of  the  features  corresponding  to  state  1  of  one  of 
the  variables  has  its  distribution  among  the  terminal  taxa 
perfectly  described  by  one  of  the  taxa  of  the  classification" , 
the  classification  of  Fie.  1(a)  must  be  a  good  classification 
for  the  data  of  Table  1.  With  this  I  heartily  concur. 

When  the  characters  are  replicated  as  indicated  in  Table  1, 
special  similarity  still  produces  the  classification  of 
^ig.  1(a),  while  raw  clustering  produces  the  classification 
of  Fie.  1(b).  Farris  (1977*834)  argues  that  since  "replica¬ 
tion  introduces  no  new  types  of  distribution  of  features 
into  the  data,  but  only  alters  the  relative  frequency  with 
whice  the  various  types  of  features  are  represented" ,  the 
classification  of  Fig.  1(a)  "remains  a  perfectly  natural 
classification  after  replication,  since  the  distribution 
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of  the  values  of  any  of  the  variables  of  the  data  may  be 
exactly  described  in  terms  of  one  of  the  taxa  of  the 
classification."  He  concludes  that  phenetic  similarity 
clustering;  can  produce  a  poor  classification,  even  in 
cases  where  a  natural  classification  can  be  recognized. 

With  this  I  also  concur. 

But  the  example  of  Table  1  involves  a  fully  con¬ 
gruent  set  of  characters,  so  there  is  already  at  hand  a 
natural  classification,  and  one  does  not  need  to  use  any 
type  of  cluster  method  to  find  it.  Does  it  therefore 
matter  whether  a  given  cluster  method  is  superior  or 
inferior  to  another  cluster  method  on  this  type  of  data? 

Is  it  not  more  pertinent  to  investigate  the  behaviour  of 
cluster  methods  with  respect  to  their  ability  to  reconstruct 
a  natural  classification  from  a  set  of  characters  that 
are  not  fully  congruent?  In  sections  3  ond  4  I  shall 
examine  this  question  in  some  detail,  and  nresent  a 
statistically  significant  large  number  of  examples  in 
which  phenetic  methods  are  superior  to  phylogenetic  methods. 

^  3.  What  is  the  situation  regarding  characters  that 
are  not  fully  congruent?  Farris  (1979!2f6)  states  in  nart 
that  "Even  for  incongruent  data,  it  goes  much  too  far  to 
say  that  sensitivity  to  repl ication  ' is  irrelevant  to 
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naturalness,  although  the  relationship  is  certainly 
more  complicated  than  in  the  congruent  case.  The 
relationship  is  complex  enough,  in  fact,  that  it  would 
probably  be  difficult  to  devise  artificial  data  through 
which  it  might  be  adequately  studied."  Rut  artificial 
examples  are  important  for  a  number  of  reasons.  Among  them 
are:  (i)  Artificial  data  can  be  designed  so  as  to 
isolate  a  property  that  one  is  studying  in  a  simple 
enough  situation  so  that  one  can  analyze  what  is  happening. 

(ii)  Artificial  examples  can  serve  as  indicators  of 
possibilities  for  the  truth  or  falsity  of  various  hypotheses. 

(iii)  If  a  proposition  about  cluster  methods  is  generally 
true,  it  must  also  be  generally  true  for  artificial  data. 
Hence  if  a  proposition  seems  statistically  to  be  false 
for  a  large  number  of  artificial  data  sets,  one  must  at 
least  question  its  general  validity.  At  any  rate,  no 
harm  can  be  done  by  examining  artificial  examples,  as 
long  as  one  uses  them  in  the  spirit  of  gaining  intuition 
as  opposed  to  establishing  facts. 

Before  any  investigation  can  be  begun,  one  must 
decide  upon  a  precise  definition  of  a  natural  classification 
for  incongruent  input  data.  Farris  ( 1977 * 8 29)  states  "the 
most  natural  classification  in  Gilmour’ s  sense  is  that 
classification  whose  constituent  groups  describe  the 
distributions  of  as  many  features  as  posiible."  If  I 
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am  to  take  this  statement  at  race  value,  it  appears  that 
Farris  is  advocating  the  selection  of  a  maximal  set  of 
congruent  characters,  and  deeming  the  classification  that 
they  represent  to  be  natural.  It  is  interesting  to  note 
that  this  represents  the  rather  elegant  method  of 
" comnatability  analysis"  advocated  by  Estabrook, 

Johnson  and  KcKorris  (1976).  But  Farris  goes  on  to 
state  (1977*830)  that  "...while  the  correspondence 
between  membership  of  a  Gilmour-natural  taxon  and 
the  distribution  of  a  feature  considered  described  by 
that  taxon  is  allowed  not  to  be  perfect,  the  taxon  can¬ 
not  very  well  be  said  to  describe  the  distribution  of  a 
feature  unless  the  correspondence  is  Kent  as  close  as 
possible." 

Though  I  plan  in  a  later  paper  to  investigate  the 
above  notion  of  a  natural  classification,  for  present 
purposes  I  shall  find  it  convenient  to  adopt  a  slightly 
different  viewnoint.  Before  proceeding,  it  is  imnera+ive 
that  I  carefully  establish  that  framework  in  which  I 
shall  be  working.  Without  such  a  framework,  any  dis¬ 
cussion  can  be  both  confusing  and  misleading.  For  examnle, 
it  is  quite  possible  that  one  of  the  causes  of  the  disoute 
between  Farris  and  myself  is  the  fact  that  we  have  made 
different  underlying  assumptions,  and  consequently  have 
arrived  at  differing  conclusions.  I  am  working  in  a 
mathematical  model  for  the  classification  problem,  so 


I  must  ignore  any  information  not  implied  by  my  abstract 
mathematical  assumptions;  on  the  other  hand,  Farris  is 
making  some  biological  assumptions,  and  can  therefore 
reach  conclusions  not  directly  implied  by  his  mathe¬ 
matical  assumptions.  Here  then  are  the  axioms  for  my 
model i 

Al.  There  is  given  a  finite  nonempty  set  P  of 
operational  taxonomic  units  (OTU's)  to  be 
classified . 

A2.  There  is  a  unique  desired  hierarchical 
classification  of  P. 

A3.  There  is  a  finite  set  A  of  binary  (presence- 

absence)  characters  from  which  the  classification 
of  A2  may  be  deduced. 

Unless  one  can  make  the  above  assumptions,  it  is 
difficult  to  see  how  the  application  of  cluster  analysis 
can  lead  to  a  useful  result.  It  is  of  course  possible 
that  if  one  changes  the  criteria  by  which  one  measures 
the  desirability  of  a  classification,  then  A2  might 
allow  a  different  hierarchical  classification,  but  with 
each  such  classification,  one  must  assume  a  set  of  char¬ 
acters  from  which  it  may  be  deduced. 


A4,  The  investigator  now  enters  the  picture  and 
introduces  some  errors  as  follows* 

(i)  He  chooses  a  subset  A'  of  A. 

(ii)  He  misreads  a  portion  p  of  the  states  of  trie 
characters  in  A',  due  to  sampling  errors, 
errors  in  measurement,  etc. 

(iii)  He  introduces  a  set  B  of  characters  that 
are  not  members  of  A. 

( iv)  He  may  even  miscode  a  small  proportion  q 
of  his  character  states. 

If  the  concept  of  a  natural  classification  is  to  be 
included,  it  seems  reasonable  that  it  might  do  so  in  the 
following  manner* 

A5*  The  set  of  characters  specified  in  A3  shall 

make  the  classification  of  A2  natural  in  that* 

(i)  Each  cluster  of  the  classification  represents 
the  preferred  state  of  some  character,  and 
(ii)  The  preferred  state  of  each  character 
corresponds  to  some  cluster  in  the 
classification. 

The  problem  now  facing  the  investigator  is  clear. 
Given  the  errors  he  has  made  in  A4,  what  is  the  cluster 
method  that  is  most  likely  to  reproduce  the  classification 
of  A2?  One  way  to  test  this  is  by  means  of  some  computer 
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simulations  of  the  types  of  errors  described  in  AU.  Such 
a  simulation  was  carried  out,  and  its  results  will  now 
be  described. 

The  first  thing  to  notice  is  that  the  investigator 
has  no  way  of  knowing  the  exact  contents  of  either  A  or 
A* i  all  he  has  is  his  version  of  A'  (possibly  including 
some  errors)  together  with  the  characters  in  B.  The  be¬ 
haviour  of  cluster  methods  with  respect  to  replication 
of  characters  and  with  respect  to  the  introduction  of 
error  characters  is  clearly  relevent  to  what  transpires 
in  A4,  a  cluster  method  that  is  relatively  insensitive 
to  the  type  of  error  descibed  in  A4  is  clearly  desirable 
in  this  situation.  As  a  first  attempt  to  obtain  some 
intuition  for  what  might  be  happening,  I  took  7  random 
characters  on  a  3  element  set,  rank  ordered  the  12 
dissimilarity  measures  that  appear  in  Table  2,  replicated 
the  characters  in  various  ways,  and  then  checked  to  see 
how  often  the  rankings  remained  unchanged  after  the 
dissimilarity  measures  were  recalculated.  Each  trial 
consisted  of  5  different  such  replications,  and  the 
portion  of  successes  was  recorded.  The  results  appear  in 
Table  3«  Using  a  nonparametric  signs  test  (Gibbons* 1976,9^) 

I  then  tried  to  assess  the  statistical  significance  that 
DCi  performed  better  than  DCj  in  this  particular  simula¬ 
tion.  At  a  significance  level  of  90%,  here  were  the  results* 
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No.  Trials 

H 

Conclusion 

25 

10 

DC10  is  better  than  all  others 

DC7  is  better  than  SC 5  and  DCO 

DC3  is  better  than  CC5 

DC11  is  better  than  DC9 

25 

5 

DC10  is  better  thah  all  others 
DC3,DC4,DC?,DC8,DC11  are  better  than  DC1 

DC 6  is  better  than  DC1.DC5.BC12 

25 

2 

DC10  is  better  than  all  but  DC5 

DC1  is  worse  than  all  others 

In  each  trial  a  character  is  replicated  a  random  number  of 
times  with  a  number  chosen  from  0,1, 2,..., T. 


Similar  results  were  performed  on  the  data  in  Table  4 
with  the  results  appearing  in  Table  5»  Using  the  same 
statistical  test  as  for  the  random  data  here  are  the 
results  at  a  significance  level  of  90%i 


No.  Trials 

T 

Conclusion 

25 

10 

DC9  is  better  than  all  others 

DC4  is  better  than  all  but  DC9 

DC1  is  better  than  DC6,DC7.DC11 

25 

5 

DC9  is  better  than  all  others 

DC4  is  better  than  all  but  DC1 ,DC2 ,DC3 ,DC9 

DC1  is  better  than  all  but  DC3.DC4,DC9 

DC2.DC3  are  better  than  DC10 

25 

2 

DC4  is  better  than  all  others 

DC1  is  better  than  all  but  DC3.DC4 ,DC8 ,DC9 

DC3  is  better  than  all  but  DC1,DC4,DC9 

DC9  is  better  than  all  but  DC1 ,DC3,DC4,DC8 

DC8  is  better  than  than  DC 2 .  DC5.DC6,DC1^,DC1? 

A  number  of  conclusions  may  now  be  drawn.  First  of  all, 
the  results  seem  data  dependent,  so  one  must  be  extremely 
cautious  in  drawing  any  conclusion  from  them.  Secondly,  thourh 
there  is  some  evidence  that  special  similarity  (DC4)  may 
perform  better  than  simple  matching  (DC1),  the  evidence  is 


-11- 


not  overwhelming.  Thirdly,  one  should  bear  in  mind  that 
those  DC' s  that  tended  to  produce  a  large  number  of  ties 
would  not  show  up  well  in  this  particular  simulation,  as 
ties  are  very  unlikely  to  remain  stable  under  replication 
of  characters.  Fourthly,  the  data  in  Table  4  is  extremely 
sensitive  to  replications  in  characters,  so  the  conclusions 
that  I  drew  from  this  data  are  probably  not  as  significant 
as  the  earlier  conclusions  that  were  based  upon  random  data. 
Finally,  in  all  but  one  simulation,  a  dissimilarity  measure  was 
best  that  happened  also  to  treat  the  character  states  symmetric¬ 
ally.  This  would  tend  to  indicate  a  superiority  of  phenetic 
over  phylogenetic  techniques.  The  results  are  of  course 
inconclusi ve ,  but  they  do  make  it  reasonable  for  me  to 
focus  my  attention  on  DC1,DC4,DC9  and  DClOs  furthermore, 
they  do  cast  some  doubt  on  the  superiority  of  DC4  as  a 
measure  of  dissimilarity.  A  more  realistic  simulation  is 
in  order,  and  it  will  be  described  in  the  next  section. 

^4.  How  well  does  a  dissimilarity  coefficient 
recapture  a  natural  classification  in  the  presence  of 
the  type  of  error  described  in  Axiom  A4?  Before  attempting 
to  answer  this  question,  a  few  words  are  in  order  con¬ 
cerning  the  ability  of  a  DC  to  recapture  a  natural 
classification  from  fully  congruent  input  characters. 

The  test  classifications  I  have  chosen  appear  in  Fig.  2, 
and  are  taken  from  D'Andrade  (1978»65).  In  view  of  the 
discussion  of  the  last  section,  I  shall  restrict  my 
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attention  to  DC1,  DC4,  DC9  and  DC10.  The  cluster  method 
I  shall  use  is  u-clustering  with  u  -  .5.  This  method 
is  described  in  some  detail  in  Janowitz  (1979a) •  basically, 
it  is  an  agglomerative  hierarchical  method  that  is 
implemented  by  merging  at  each  level  those  pairs  of 
clusters  for  which  at  least  half  of  the  possible  links 
have  been  made.  Despite  the  discussion  of  section  2,  it 
is  not  at  all  clear  that  DC4  necessarily  produces  the 
most  faithful  representation  of  the  classifications  in 
Fig.  2.  If  one  represents  these  classifications  as 
indicated  in  Tables  6-9,  for  example,  an  examination 
of  Figures  3-6  seems  to  indicate  that  DC10  best  reore- 
sented  Fig.  2(a),  DC4  and  DC9  were  best  for  Fig.  2(b), 

DC4  was  best  for  Fig.  2(c),  while  DC1  was  best  for 
Fig.  2(d). 

Since  I  am  attempting  to  isolate  the  behavior  of 
cluster  methods  with  respect  to  their^'abil ity  to  recao- 
ture  natural  classifications  in  the  presence  of  certain 
types  of  errors,  it  is  essential  that  I  start  with  a 
character  representation  of  hierarchical  trees  that 
allows  the  trees  to  be  perfectly  recaptured  by  all  of 
the  DC*s  under  consideration.  To  see  how  this  goes,  and 
incidentally  to  see  what  went  wrong  with  the  earlier 
attempt,  consider  the  clusters  that  are  found  at  each 
level  of  Fig.  2(a) » 
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Level 

— — — ...  —  —  _  

Clusters 

Character  Representation”* 

1.2,3.4,5,6,7,8,9.10 

10-19 

12,34,56,78,9-10 

1.2, 3. 4, 5 

1-4,56,78,9-10 

6, 3. 4, 5 

3 

1-6,78,9-10 

7.4,5 

4 

1-8,9-10 

8,5 

-  5 

1-10 

9 

Notice  that  Character  3  must  be  used  twice.  Character  4 
is  used  3  times,  and  Character  5  4  times.  In  Table  6  this 
information  is  contained  in  the  last  row,  where  it  is 
indicated  how  many  times  each  character  must  be  replicated 
in  order  to  perfectly  reflect  the  data.  Similar  observa¬ 
tions  apply  to  Tables  7-9.  When  the  characters  are  repli¬ 
cated  as  indicated,  each  of  DC1  through  DC12  will  perfectly 
represent  the  appropriate  classifications  of  Fig;.  2.  A 
moments  reflection  should  convice  you  that  though  our 
earlier  scheme  seemed  reasonable,  it  had  no  hope  of  success 
because  it  did  not  reflect  all  of  the  clusters  at  each 
level  at  which  they  appear.  It  is  interesting  to  note 
that  Farris(1979)  did  not  run  into  this  problem  because 
no  replications  of  characters  are  needed  to  perfectly 
represent  the  tree  of  Fig.  1(a). 

Having  disposed  of  the  manner  in  which  I  shall 
reoresent  a  natural  classification,  I  can  now  begin  to 
introduce  some  errors.  For  each  data  set  I  introduced  3 
extra  characters  that  consisted  of  random  binary  data. 


I  then  applied  DCi  (i  -  1, 4,9,1°)  followed  by  u-clustering 
(u  a.  .  5)  .  The  goodness  of  fit  of  the  resulting  classi  ficati  or 
to  the  original  cl assi ficati on  was  then  measured  in  4  way?. 
Method  1.  A  product  moment  corre  lation  war  comnuted 

between  the  output  DC  d  of  the  cluster  method  and  the 

d* 

original  unperturbed  BC^that  reflected  nerfectly  the 
desired  classification. 

M e th od  2.  Each  classification  represents  a  certain 
collection  of  desired  clusters.  The  number  of  missing 
but  desired  clusters  was  counted. 

Method  3.  The  number  of  extraneous  clusters  added  by 
the  error  characters  was  counted. 

M  e  th  od  4.  A  distance  was  computed  between  d  and  d'  of 
Method  1  by  counting  up  the  number  of  unordered  pairs 
Ci  a  ,b"} ,  [  x  ,y }}  for  which  either  (i)  d(a,b)  =•  d(x,y)and 
d'(a,b)  /  d '  (x,y)  ,  or  (ii)  d(a,b)  /  d(x,.y)  and  d’(a,b)  - 
d * ( x  ,y ) ,  or  (iii)  d(a,b)  <  d(x,y)  and  d’(a,b)  >  d'(x,y). 
This  is  then  normalized  by  dividing-  by  the  total  number 
of  unordered  pairs  [ (a ,b} , {x ,y } } . 

There  were  10  trials  performed  on  each  data  set  and  with  each 
DCi  (i  =  1,4,9i10)  though  in  some  cases  DC9  was  not  considered . 
A  summary  of  the  results  appears  in  Table  10,  with  Table  11 
summarizing  the  number  of  times  that  DCi  performed  better  than 
DCj  in  Method  1.  Note  that  the  evidence  points  to  DC4  being 
the  worst  choice  and  DC10  the  best  choice  with  respect  to  the 
recapture  of  a  natural  classification  in  the  presence  of  error 


characters 
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Kaving  investigated  the  effect  of  the  addition  of 
random  error  vectors,  I  then  turned  to  the  consideration 
of  errors  in  reading  character  states.  The  data  sets 
contained  in  Tables  6, 7, 8,9,1  were  again  used,  but  now 
each  character  was  doubled  and  a  5#  random  error  in 
reading  states  was  introduced.  Ten  trials  were  performed 
on  each  data  set  and  each  DCi  (i  =  1,4,8,10).  A  summary  of 
the  results  appears  in  Table  12,  with  Table  13  indicating 
the  number  of  times  that  DCi  performed  better  than  DCj 
with  respect  to  the  criterion  of  Method  1.  I  also  compared 
DC4  with  DC10  using  5  trials  with  a  15$  error,  the  results 
appearing  in  Table  14.  The  only  significant  conclusion 
that  can  be  drawn  from  this  data  is  that  DC10  performed 
better  than  the  other  DC's,  though  it  should  be  noted 
that  there  was  one  instance  (with  data  from  Table  6) 
where  DC4  was  superior  to  the  others. 

As  a  final  simulation,  I  doubled  each  character, 
introduced  a  5$  random  error,  then  added  6  random  error 
characters,  and  finally  discarded  10%  of  the  resulting 
characters  in  a  random  fashion.  The  intent  was  to  simulate 
the  errors  described  in  Axiom  A4  of  the  model.  With  respect 
to  the  criteria  of  f>ethods  1  and  4,  the  results  are 
tabulated  In  Table  15*  Notice  that  DC4  is  sonsistently 
the  worst  choice  of  those  I  considered. 
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With  respect  to  all  of  tnese  simulations,  the  evidence 
overwhelmingly  indicates  that  a  DC  that  treats  character 
states  symmetrically  is  superior  to  Farris'  coefficient 
of  special  similarity.  In  short,  though  special 
similarity  performs  well  with  respect  to  its  ability 
to  recapture  a  natural  classification  from  fully  congruent 
input  characters,  it  does  a  poor  job  in  the  more  general 
situation  where  the  input  characters  are  not  fully 
congruent. 
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J>  5*  The  role  of  the  cophenetic  correlation  coefficient. 
This  coefficient  is  the  ordinary  product  moment  correlation 
between  the  input  and  output  dissimilarity  coefficients 
of  a  cluster  method.  In  both  of  his  papers  Farris  uses 
this  coefficient  as  a  measure  of  performance  of  a  dis¬ 
similarity  coefficient.  In  my  earlier  paper  ( Janowitz , 1979) 
I  objected  to  this  and  presented  an  extreme  illustration 
of  what  can  go  wrong.  Farris  (1979*207)  questioned  the 
validity  of  my  objection,  and  quite  clearly  explained 
why  he  wishes  to  use  this  particular  measure  of  optimality. 
The  reader  will  find  it  instructive  to  read  this  section 
of  Farris'  paper.  In  view  of  this,  it  is  appropriate  for 
me  to  begin  this  discussion  by  restating  my  earlier  ob¬ 
jection. 

The  type  of  clustering  algorithm  under  discussion 
is  a  two  stage  algorithmi 

Stage  1.  Character  data  — >  dissimilarity  measure 

Stage  2.  Dissimilarity  measure  — >  classification. 

The  cophenetic  correlation  coefficient  is  a  measure  of 
the  optimality  of  the  second  stage  of  the  algorithm.  It 
can  be  used,  for  example,  to  compare  the  relative  merits 
of  single  linkage  and  complete  linkage  clustering  when 
they  are  applied  to  the  same  dissimilarity  coefficient. 
Farris  makes  the  error  of  using  this  Stage  2  measure  to 
determine  the  optimality  of  the  Stage  1  portion  of  the 
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process.  Since  the  cophenetic  correlation  coefficient 

completely  ignores  the  nature  of  the  input  characters,  * 

it  can  hardly  decide  how  well  the  intermediate  DC  fits 

the  original  input  data.  What  I  suggested  in  my  earlier 

paper,  and  what  I  now  suggest,  is  that  one  wants  a 

measure  of  optimality  that  relates  the  intermediate  DC 

to  the  original  input  data,  and  not  to  the  ultimate 

} 

output  classification.  Of  course  this  is  precisely  what 
was  done  in  Section  4,  and  I  now  wish  to  compare  the 
results  in  Tables  10-15  with  those  of  the  cophenetic 
correlation  coefficient.  A  summary  of  the  results  occurs 
Tables  16-18.  They  are  quite  different  from  the  results 
that  occur  in  Tables  10-15*  The  cophenetic  correlation 
indicates  that  DC9  is  the  best  DC  to  use,  while  the 
earlier  results  (based  upon  actual  performance)  indicate 
that  DC10  is  superior.  Notice,  however,  that  despite 
the  claims  made  by  Farris  (1977,1979)  to  the  contrary, 
the  cophenetic  correlation  coefficient  for  DC1  is 
consistently  higher  than  it  is  for  DC4  (See  Table  16). 

To  further  illustrate  the  d iscrepenc ies  caused  b^  using 
the  cophentic  correlation  as  a  Stage  1  measure  of  optimality, 

I  ran  a  product  moment  correlation  between  the  values  of 
this  measure  and  the  Method  1  measure  that  directly 
determines  Stage  1  optimality.  The  results  occur  in 
Table  19.  They  provide  a  vivid  illustration  of  the 
collapse  of  the  cophenetic  correlation  coefficient  as  a 
measure  of  Stage  1  optimality. 


As  a  final  item  in  this  section,  the  reader 
should  recall  that  in  both  of  his  naners,  Farris 
stresses  the  importance  of  real  examples.  Indeed, 
in  Farris  (1979*212)  he  states,  "No-one,  however, 

a 

has  nroduced  any  analyses  of  real  cases  that  give  results 
different  from  mine.  ...  If  nheneticists  wish  to  dispute 
ry  findings,  I  would  submit,  then  they  can  only  do  so 
through  evidence  from  real  organisms".  vow  I  am  a 
i,  .n  thematic  ian  and  not 'a  taxonomist,  so  it  would  hardly 
he  appropriate  for  me  to  attempt  any  such  analysis  of 
real  organisms.  However,  I  did  compare  raw  clustering 
with  special  similarity  on  two  real  examples.  Usine 
data  from  Watson,  Williams  and  Lance  (1966*495)  and 
Esins'  a  as  denoting  presence  with  -  as  absence  of  each 
character,  and  takin?  as  a  reference  point  an  OTF 
whith  each  state  as  -,  the  following  values  of  the 
conhenetic  correlation  cos  rfj  cient  were  obtained  via 
u  -  .  5  cl  -  r!".  * 

PCI  -  ,°9 6,  DC4  -  .7925,  LC9  rr  .9621,  DC1F  -  .9162. 
The  :econd  data  set  I  chose  was  from  Ferris  and  Whitt 
(197°  *195) .  This  time  I  used  single-linkage  clustering, 
u  -  ,5  clustering,  an d  a  version  of  complete  linkage 
clurterint .  I  took  as  my  reference  point  an  OTU 
poia  1 1  a! nP'  none  of  the  characters  (as  was  intended  by 
the  authors  of  the  source  material).  The  results  werei 
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DC1 

DC4 

rro 

DC10 

single 

.8412 

.788  3 

.856  3 

.6325 

u  -  .5 

.87fl 

.7289 

.8684 

.  734 

complete 

.8254 

.6144 

.  6840 

.  73n3 

F  o  t 5  that  in  both  of  these  examples ,  special  sir  ilarity 
does  not  perform  as  well  as  raw  clustering! 

In  order  to  see  why  these  results  differ  so  much 
from  those  reported  by  Farris,  one  might  consider  the 
manner  in  which  he  assigned  his  reference  points.  In 
Farris  (1977*836)  he  states  that  "the  reference  point 
used  in  each  special  similarity  analysis  being  arbitrarily 
selected  as  one  of  the  terminal  taxa  of  the  data" ;  in 
Farris  (1979*210)  he  reports  that  the  reference  point 
was  "taken  simply  as  the  first  terminal  taxon  of  the 
data  set."  When  I  applied  this  choice  of  reference 
point  to  the  2  examples,  I  obtained  results  comparable  to 
those  claimed  by  Farris.  Rut  this  artificially  asserts 
which  state  of  a  character  shall  be  informative  with  no 
regard  to  the  biological  significance  of  the  data.  The 
reader  must  decide  whether  this  is  a  reasonable  thing 
to  do.  This  situation  will  be  explored  in  greater  dent'n 
in  a  later  paper. 
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6.  Conclusion.  In  my  paper  (Janowitz,1979)  I  very 
carefully  refrained  from  taking  a  position  on  Farris’ 
contention  that  phylogenetic  methods  are  better  than 
phenetic  methods.  All  I  did  was  attempt  to  show  that  in 
view  of  some  flaws  in  Farris'  reasoning,  the  issue 
should  still  be  regarded  as  unresolved.  This  is  the 
position  I  still  maintain. 

For  certain  types  of  data  I  have  shown  the  superiority 
of  Yule's  coefficient  (a  coefficient  that  treats  character 
states  in  a  symmetric  manner)  to  both  simple  matching  and 
special  similarity.  I  did  net  show  and  do  not  wish  to 
assert  that  this  makes  Yule’s  coefficient  better  to  use 
on  all  data.  However,  if  the  data  has  the  property  that 
for  each  CTU  there  corresponds  a  character  possessed 
uniquely  by  that  OTU,  then  my  results  indicate  that  Yule’s 
coefficient  is  at  least  worth  trying.  The  relative  merits 
of  special  similarity  versus  simple  matching  were  left 
largely  unresolved,  though  the  evidence  tended  to  favor 
simple  matching. 

In  addition  to  an  argument  based  upon  logic,  I 
~ave  detailed  empirical  evidence  as  to  why  the  cophenetic 
correlation  coefficient  should  not  be  used  to  determine 
the  relative  merits  of  one  dissimilarity  measure  over 
another.  This  was  done  within  the  framework  of  a  model 
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that  was  introduced  in  Section  3  of  the  paper.  There  is 
much  work  remaining,  and  the  results  seem  to  raise  as 
many  questions  as  they  asnwer.  Hopefully,  I  have 
demonstrated  that  despite  many  claims  to  the  contrary,  no 
clear  case  has  yet  been  made  for  the  superiority  of 
phylogenetic  over  phenetic  clustering. 

I  also  raised  tne  question  of  the  representation 
of  a  natural  classification  by  means  of  binary  character 
data.  If  one  adopts  the  convention  I  introduced  in 
Section  3,  then  there  is  no  difficulty  in  arriving  at 
a  representation,  but  such  a  representation  would  not 
be  stable  under  replication  of  characters;  even  for  fully 
congruent  data  sets,  the  arguments  presented  by  Farris 
(1977*833)  would  be  invalid.  On  the  other  hand,  if  one 
does  not  adopt  such  a  scheme,  one  need  only  consider  the 
classifications  of  Figure  6  to  see  what  car  go  wrong.  The 
clusters  are  the  same  in  each  classification,  but  they 
arise  at  differing  levels.  How  does  one  represent  this? 
Must  one  agree  to  identify  all  4  of  the  classifications? 
The  reader  might  wish  to  ask  whether  it  is  either 
necessary  or  desirable  to  even  search  for  natural  class¬ 
ifications! 

I  spent  some  time  examining  the  question  of  why  my 
results  differed  so  drastically  from  those  of  Farris. 


As  a  ossible  explanation,  I  presented  examples  in  which 
T  obtained  results  consistent  with  my  earlier  results 
*her  the  incut  characters  were  coded  as  intended  by  the 
authors  of  the  source  data,  but  which  agreed  with  Farris 
when  the  reference  noint  was  chosen  in  the  artificial 
'■anner  he  claims  to  have  used.  It  is  interesting  that 
"ur-rin  insists  on  the  one  hand  that  he  must  use  real  data 
to  obtain  meaningful  results,  while  on  the  other  hand,  he 
chooses  to  ignore  that  real  data,  instead  choosing  his 
reference  point  in  ar.  arbitrary  manner.  He  also  makes 
no  mention  of  the  extent  to  which  his  results  produce 
useful  classifications.  Somewhat  similar  observations 
were  made  by  Sakai  and  Fohlf  at  the  FT13  meeting;  that  was 
held  at  Harvard  Cctober  26-7,  1977.  I  admit  that  my  pair 
of  examples  uroves  nothing;  they  merely  serve  to  indicate 
a  possible  explanation.  The  matter  will  be  more  extensively 
nursued  in  a  later  naper. 

In  closing  I  would  like  to  mention  one  further 
reason  why  special  similarity  does  not  perform  well.  As 
I  have  done  earlier,  I  am  restricting  my  attention  to 
binary  characters  in  which  1  is  the  preferred  state.  The  problem 
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night  lie  in  the  fact  that  special  similarity  not  only 
ignores  matched  0's,  but  it  also  ignores  information 
provided  by  characters  possessed  by  one  but  not  both 
objects  of  a  pair  under  consideration.  Thus  it  treats 
eaually  the  following  3  pairs  of  objects; 

ax  100000000000 
100000000000 

A2  111111111  110 
-32  100000000000 

A^  11111100000  0 
B^lOOCOOlllllC 

But  one  can  argue  that  (A^,B1)  should  be  more  similar 

than  either  of  the  other  pairs.  Similar  examples  car. 

be  constructed  for  characters  having  more  than  tv.c  states. 

Acknowl edgement.  The  programs  needed  for  this  naper  were 
written  by  Zachary  Smith,  and  the  data  trocer.sed  on  the 
University  of  Kassachusetts  Control  Data  Corporation 
CYBER  70  computer. 

vote.  For  purposes  of  drawing  the  tree  diagrams  in  the 
figures,  each  DC  was  rank  ordered. 


Figure  4.  Classifications  for  data  in  table  7. 


g  a. 


(c)  DC  9  I 

Figure  6.  Classifications  for  data  in  table  9. 
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ArPENDIX 
Table  1. 


Char- 

acter 

1 

4 

5 

6 

7 

8 

9 

10 

11 

if 

13 

14 


LIST  CF  TABLES . 

Hypothetical  Data  Matrix. 

From  Farris  (1979s 2<">1) 
Taxa  " 

I  2  3  4  5  5  7  6 


1  0 
0  1 

0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
1  1 
0  0 
0  0 
0  0 
1  1 
0  0 


0  0 
0  0 
1  0 
0  1 
0  0 
0  0 
0  0 
0  0 
0  0 
1  1 
0  c 
0  0 
1  1 
0  0 


0  0 
0  0 
0  0 
0  0 
1  0 
0  1 
0  0 
0  0 
0  0 
C  0 
1  1 
0  0 
0  0 
1  1 


n  o 
0  0 
0  0 
0  0 
0  0 
0  0 
1  0 
0  1 
0  0 
0  0 
0  0 
1  1 
0  0 
1  1 
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Table  3*  Summary  of  random  data  results.  The  figures  relate 


to  the  percentage  of  success  in  25  trials. 

r 
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Table  5*  Nummary  of  results  for  data  in  Table  4.  The 


figures  relate  to  the  percentage  of  success  in  25  trials 
of  5  replications  each. 


DC 

T  s  10 
Kean 

3D 

kxh 

T  -  2 
Kean 

SD 

1 

.04 

.0817 

.0?2 

.1275 

.2 

.2 

l 

.016 

.0554 

.04 

.0817 

.112 

.1641 

3 

.04 

.0817 

.056 

.0917 

.256 

.1781 

4 

.088 

.1013 

.36 

.2082 

.36 

.2082 

5 

.008 

.04 

.032 

.0748 

.112 

.1641 

6 

0 

0 

.016 

.05538 

.112 

.1641 

7 

.008 

.04 

.024 

.0663 

.1? 

.1528 

8 

.04 

.08165 

.032 

.0748 

.144 

.1583 

9 

.24 

.1732 

.208 

.1869 

.208 

.1869 

10 

.016 

.0554 

.008 

.04 

.096 

.1541 

11 

.008 

.04 

.024 

.066  3 

.12 

.  1  528 

12 

.024 

.0663 

.04 

.1 

.04 

.1 

Table  6.  Hypothetical  Data  Matrix  Designed  to  Represent 
Classification  Indicated  in  Fifr.  2  (a) 


Character 

10 

11 

12 

13  14 

15 

16 

17 

18 

19 

1  0 

0 

0 

a 

1 

1 

1 

1 

1 

0 

0 

0 

0 

A 

A 

A 

p 

0 

1  0 

0 

0 

n 

1 

1 

1 

1 

n 

1 

0 

0 

a 

p 

A. 

A 

A 

A 

0  1 

0 

n 

0 

1 

1 

1 

1 

0 

p 

1 

0 

0 

0 

0 

p 

p 

0 

0  1 

0 

0 

0 

1 

1 

1 

1 

0 

0 

0 

1 

0 

0 

p 

A 

A 

0 

n  0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

p 

0 

1 

0 

A 

(J 

0 

0 

p 

0  0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

0 

0 

0 

1 

0 

A 

A 

p 

0  0 

0 

1 

0 

0 

0 

1 

1 

0 

0 

0 

0 

P 

0 

1 

p 

0 

p 

0  0 

0 

1 

0 

0 

a 

1 

1 

0 

A 

u 

0 

0 

0 

Q 

A 

1 

0 

0 

0  0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

A 

0 

0 

A 

0 

A 

1 

n 

0  0 

0 

0 

1 

g 

n 

p 

1 

p 

0 

0 

0 

p 

n 

A 

p 

0 

1 

0  0 

1_ 

2 

J- 

p 

_0 

0 

_0_ 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 
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Table  7.  Hypothetical  Data  Matrix  To  Represent 
Classification  in  Fig.  2  (b) 


Character 


10  11  12  13  14  15  16  1?  18  1 


101010101  1  0  0  0 

101010101  0  1  0  0 

001010101  0  C  1  0 

000010101  0  0  0  1 

000000101  0  0  0  0 


000000011  0  0 
000001011  0  0 


000101011 

010101011 

010101011 


000000000 


0  0 
0  0 


0  0  0  0 
10  0  0 
0  10  0 


0  0 
0  0 


0  0  0  0 
0  0  0  0 
0  0  0  0 


0  1 
0  0 
0  0 


0  0 
0  0 
0  0 
0  0 


0  0  0  0  0  0 


0  0 
0  0 


0  0 
0  0 
0  0 
0  0 
0  0 


0  0 


2  1 


Table  3.  Hypothetical  Data  Matrix  To  Represent 
Classification  in  Fig.  2  (c) 


■  Character  ; 

1 

2 

JL 

4 

J_ 

7 

o 

9 

10 

11 

12 

J_X 

14 

_Li 

16 

XL 

18 

19 

1 

0 

0 

1 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

1 

0 

0 

1 

n 

1 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

1 

0 

1 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

1 

n 

1 

0 

1 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

1 

0 

1 

0 

1 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

0 

1 

0 

0 

0 

o 

0 

1 

0 

0 

0 

0 

o 

0 

o 

0 

0 

0 

0 

1 

1 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

1 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

1 

o 

0 

0 

1 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

_0_ 

0 

0 

0 

_0 

0 

0 

0 

1 

o 

0 

1 

2 

1 

0 

0 
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Table  9.  Hypothetical  Data  Matrix  To  Represent 
Classification  in  Fie-.  2  (d) 


Table  10.  Summary  of  results  on  addition  of  3 
random  error  characters 


E 

DC 

Method  1 

M  e  th  od  2 

Method  3 

Methor 

- 

v  e  a  n 

SD 

Mean 

SD 

M  e  a  n 

SD 

Mean 

SD 

6 

.9809 

. °1179 

mjm 

mm am 

•  ^ 

.6325 

.0123 

>074“ 

D 

.9237 

.05477 

K  - 

•  > 

.6749 

.1562 

.0592 

to 

.9818 

.02123 

v*m 

.1 

.3162 

.0117 

7 

H 

.9789 

.03481 

.6992 

.1 

.3162 

n  ?  c. 

0.  r<  r;  £ 

□ 

.9218 

.03481 

3.2 

.7888 

.6 

.4889 

.106 

. r  555 

to 

.9869 

.01639 

.6 

.6992 

.2 

.4216 

.0296 

8 

i 

.9503 

.05002 

1.3 

1.419 

.1 

.  3162 

" .0784 

.11  21 

4 

.774 

.1715 

4.1 

1.37 

0 

•  ( 

.6749 

.2389 

.1403 

9 

.9205 

.0456 

1.8 

1.317 

.  6 

.6992 

.1327 

.1435 

10 

.9253 

.1072 

1.3 

1.252 

.  3 

.6749 

.10  78 

.  1 326 

9 

.9738 

.01322 

1.4 

I.075 

.  5 

.527 

.0317 

.0159 

El 

.8732 

.10  38 

3.7 

l.n59 

O 

•  v. 

.7888 

.1568 

.139 

B 

.9397 

.0342 

1.3 

1.16 

.7 

.6749 

.03^9 

.0122 

to 

•  98  99 

."0769 

.6 

.6992 

.4 

.  5164 

.  o252._ 

.OIK 

1 

i 

.0166 

,  pO,  on  i 

mmmm 

.4 

,  r  002 

KPK 

.0641 

4 

.6235 

.  3698 

m&m 

.8 

1.393 

.3167 

Ocno 

•  «-  >  < 

9 

.7797 

.  2466 

hlI 

.9 

1.37 

.1362 

10 

« 9.63_ 

.03663 

mmm 

• 

.4216 

r\7  c  0 

— • _ 

•  _ 

Mote  ••  See  text  for  a  description  of  the  4  methods.  Observe 

that  smaller  values  of  Method  4  represent  better  result, 
while  the  opposite  is  true  for  the  other  methods. 


n  c 
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Table  11.  Number  of  times  thJ>+  DCi  performed  better 
than  DCj  on  data  from  Table  10. 


]- 

Data 

From  T 

able 

Total  No, 

6 

7 

9 

Hj 

Total 

Trials 

DC10  better 
than  DC9 

z_ 

1C 

jz 

24 

29 

0 

y 

10 

10 

10 

8 

47_ 

Ji2 _ 

;  DC10  better 
than  DCI 

6 

8 

5 

10 

7 

35 

49 

DC9  better 
than  DC4 

10 

7 

7 

24 

29 

DCI  better 
than  DC9 

9 

9 

7j 

25  1 

_Z2 _ 

1  DCI  better 
than  DCh 

10 

10 

10 

10 

V 

48 

49 

Note  t  One  trial  was  omitted  from  the  data  of  Table  ! 

because  DC4  produced  a  constant  output  for  which 
a  product  moment  correlation  could  not  be  calculated. 
Cn  this  trial,  the  correlations  for  DC1,DC9  and  DC10 
were,  respectively,  .9217,  .7889,  and  .9852. 

Fable  12.  Summary  of  results  on  introduction 
of  5.7-  random  error 


ata 
i  able 


DC 

1 


I. 


9 

10 


1 

4 

9 

10 


1 

4 

9 

10 


1 

4 

9 

10 

? 


9 

1" 


.ethoa  1 


mean 


SD 


.9353 
.974  5 
.9454 

79^3 

.9404 
.938  5 

-iil£ 


."4752 

.02951 

.04724 

.02846 

702941 

.04181 

.0389 

.0271 


•  y 


094  .07074: 

.08961 
.03548 
:8  528 


.9142 
.918  3 
.9466 


.9539 

.9292 

.9277 

.  9608 


;05 
.8864 
.9477 
.986 


.03724 

.07129 

.04512 

.06278 


. n 3271 
.  2406 
.0427 
.00922 


Method  4 


Mean  SD 


.  1098 
.02838 
.02808 
,03788 


.07667 

.07576 

.06475 

.06545 


.1025 

.05097 

.05124 

.0569 


707269 

.05765 

.  06629 

.0656 


.1129 

.1048 

.08616 

.08758 

.06768 

.09747 

.06747 

.06768 


0964: 
.1148 
.08377 
.08279 


.0537 

.1085 

.05212 

■r,lig65- 


.1067 

.101 

.1088 

.1067 


.06059 

.186 

.01389 

.0148 3 


lobe »  u  -  .6  clustering  was  used. 
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Table  13.  Number  of  times  that  DCi  performed  better 


than  DCj  on  data  from  Table  12. 


1 _ 

Data  From  Table 

Total 

~7  £T  9  i~ 

DC10  better 
than  DC 9 

9  10  9  ?  8 

45 

DC19  better 
than  DC4 

mm 

_J4 

DC 10  better 
than  DCI 

10  9  8  8  8 

43 

DC?  better 
than  DCI 

7  4  5  2  4 

22 

DC4  better 
than  DC? 

10  7  7  6  6 

9  6  6  3  5 

f 

29  i 

Table  14.  Summary  of  results  on  introduction  of  15$ 
random  error  (5  trials). 


Correlation 

Table 

DC 

Nean 

SD 

% 

mm 

.6302 

.1,35 

Id 

.7756 

.2425 

7 

0L| 

Id 

Rd 

8 

mm 

■EMM 

Id 

HI 

Kffpl 

9 

mm 

.6088 

.178 

id 

.6961 

.2171 

1 

mm 

.  268  3 

^T2T95 

Id 

.4181 

■  2251. 

Notes  See  Note  for  Table  12. 


Table  15*  Summary  of  results  for  simulation  of 
composite  Axiom  A4  error  (5  trials). 


Data 

Table 

DC 

Method  1 

Mean  SD 

Method  4 

Mean  SD 

mmm 

73233  .1034  " 

.1578  71376“ 

mm 

.8 385  .1769 

.202  .1793 

1 

.8611  .06172 

.1246  .1072 

WSM 

.365  .2045 

.1402  .1552 

7 

1 

.902  .05696 

.T361  .1186“ 

4 

.8506  .03606 

.204  .08058 

9 

.872  .04642 

.1422  .1108 

10 

*.3612  .1312 

.1416  .1136 

8 

1 

.3445  .1705 

4 

.8042  .1712 

.2133  .2005 

9 

.8546  .1209 

.1562  .2083 

10 

.8301  .28^7 

.1527  .2031 

9 

1 

.9373  .0331 

.06222  ,0334j 

4 

.8841  .05317 

.0998  ,02252 

9 

.8829  .05768 

.06121  .0330f 

10 

.9174  .01604 

.06303  .03531 

1 

1 

.732  .1563 

.2587  .1817 

4 

.3895  .3985 

.4619  .1965 

9 

.6862  .1166 

.1587  .1345 

10 

.8542  .1197 

.146  .11£L, 

Table  16.  Summary  of  results  using  cophenetic 
correlation  coefficient, 


Data  | 
Table!  DC 


1  error 
Mean 


%  error 


ixiom  A4  erroi 


SD 

Mean 

SD 

v.ean 

SD 

0204 

.  9194 

.0203 

78917 

.05091 

0698 

.9424 

.02204 

.8486 

.08884 

.9747 

.01962 

.9405 

.03649 

0199 

8 

.9078 

.02902 

.8394 

.1163 

00673 

.88  76 

.03746" 

.8578 

.0518S" 

.8916  .02111  .9038  .02711  .8575  .0529? 

.954  .01974  .9329  .02459 

.8873  .03647  .8688  .02597  .8158  .05825 


.037551.8475  .050 


.8158  .0582' 
'.0  5l6  .0636? 


.7803  .05838  .8713  .04383  .7906  .08261 
.933  .01441  .9402  .0207  .926  .03768 


9267  .01839  .91 
8425  .05963  .89 
954  .01383  .95 
8 
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Table  l7.  Number  of  times  that  cophenetic  correlation 
was  higher  for  DCi  than  DCj  on  data  with 
3  error  characters  from  Table  14. 


Data  from  Table 

Total 

Total 

Trials 

Z  7  5  9  r 

DC 9  better 
than  DCI 

10  10  7 

■§] 

29 

DC9  better 
than  DC4 

10  10  8 

28 

29 

DC9  better 
than  DC10 

10  10  8 

28 

..  29  .. 

DCI  better 
than  DC4 

10  10  10  9  6 

nn 

49 

DCI  better 
than  DC10 

iwim 

46 

49 

DC10  better 
than  DC4 

94775 

32 

49 

Note «  One  trial  was  omitted  from  Table  1.  See  Table  11. 

On  this  trial  the  values  for  DCI,  DC9  and  DC10  were 
.76 56,  .8152  and  .766 3. 


Table  18 .  Number  of  times  that  cophenetic  correlation 
was  higher  for  DCi  than  DCj  on  data  with 
%  error  from  Table  It. 


Data 

from 

Table 

6 

7 

8 

9 

1 

Total 

DC9  better 
than  DCI 

10 

10 

10 

10 

10 

50 

t)C§  better 
than  DC4 

10 

10 

10 

10 

10 

50 

DC9  better 
than  DC10 

10 

10 

10 

10 

10 

50 

DCI  better 
than  DC10 

7 

? 

5 

8 

5 

34 

DC4  better 
than  DC10 

10 

10 

7 

4 

■? 

36 

DC^  better 
than  DCI 

_2 _ 

6 

7 

2 

3 

_ 27 _ 
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Table  19,  Correlation  between  results  of  Table  It 
with  results  of  Tables  10  and  12 


Table 

3  error  char. 

5#  error  data 

6 

.8093 

'  .3145 

? 

.2502 

-.07789 

.6538 

.07483 

.^59 

.1509 

i 

_ .'+175 

.8228 

Table  20.  Cophentic  Correlation  for  results  of 
Table  14. 


Table 

DC 

Correlation 

Kean  SD 

6 

H 

7 

10 

.7007  .1472 

.7472  .04824 

8 

HI 

7583  .06887" 

.6576  .05599-. 

9 

H 

f  /tTJlilAWJ 

HIM  UJ M 

1 

1*9 

.5994  .1563 

.622  .07049 
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